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Title : SYSTEM AND METHOD FOR GENERATING STEREOSCOPIC 

IMAGE DATA 

FIELD OF THE INVENTION 

This invention relates to the field of computer graphics animation, 
and in particular, to stereoscopic image generation. 

5 

BACKGROUND OF THE INVENTION 

The recent surge in the quantity and quality of computer graphics 
10 animation for two dimensional (2D) or "monoscopic" media presentation 

such as film or video, is largely attributable to the continued increase of 
computer processing power, coupled with the constant evolution of 
computer graphics animation techniques. 

15 Typically, such animation involves the development of three 

dimensional (3D) modelling constructs in artificial computer space. The 
sets and props (including landscapes, buildings, trees, vehicles, furniture, 
etc.) as well as the characters are modelled three dimensionally in 
computer (or virtual) space having a 3D coordinate system, and stored as 

20 modelling data. The modelling constructs are usually collections of 

geometric surfaces built from mathematical primitives. The movement 
and modification of the characters and props is also stored and 
manipulated by the computer as a series of data paths correlated to time 
and 3D space commonly referred to as "animation curves". 

25 

The succession of two dimensional (2D) views of the animated 
sequence that become the frames in the film or video display, are usually 
defined by placing a viewpoint in the scene in the artificial computer space 
that "looks" in a certain direction, with a defined field of view (which may 
30 be stored as camera characteristic data). This point of view has many of the 
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characteristics of a real world camera and lens, and its placement and 
movement within the modelled scene is analogous to the use of a camera 
on a real world movie location. Unless expressly indicated otherwise, 
reference to a "camera" in this specification including the claims, refers to 
5 this form of simulated camera used in artificial computer space. 



It should be understood that when used in this specification 
including the claims, the term "animation sequence" may include one or 
more animation sequences which have been joined together. 

10 

Animation curve data is also generated and stored with respect to 
the desired movement and manipulation of the simulated camera. The 
camera's animation curve data is synchronized with the various 
animation curves used to move and manipulate the various characters 

15 and props, in order for the camera to be able to view the animated action. 

Through a complicated series of computations called "rendering", the 
computer then calculates the view for each frame to approximate what a 
real world camera would "see" if it was positioned and provided with 
characteristics similar to the simulated camera and if the modelling 

20 constructs were actually solid objects in the real world. 

When the animation sequence is complete, the data generated (and 
typically stored) by the animation process includes the modelling data and 
the related modelling animation curve data, data relating to the 

25 characteristics of the camera, such as field of view, aspect ratio, resolution 

and horizon position, as well as the camera animation curve data, and the 
rendered 2D computer graphics animation images which form the 
animation sequence. As a result, the modelling data and related 
animation curve data and the camera characteristics data and. camera 

30 animation curve data may be remanipulated so that a different animation 

sequence may be rendered. 
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It should be understood that when used in this specification 
including the claims, the term "horizon position" refers to the vertical 
offset which may be applied to change the normal horizon position in the 
5 image. For large format theatres, typically a vertically off-centred lens is 

used to change the normal horizon position which is typically in the 
vertical centre of the image. 

Less common, but still relatively well-known, is the ability to 
10 generate a simulated 3D or "stereoscopic" image by combining two 2D 

images (a left and a right image) of the same scene, each from a slightly 
different perspective. Typically, both 2D images are presented 
simultaneously (or in sufficiently rapid alternation to appear to be 
presented simultaneously) on the same 2D medium, such as a film or TV 
15 screen. Through one of several different known techniques, such as the 

use of filtered or shuttered lenses or head-mounted display devices 
containing a miniature video screen for each eye, the left image is 
restricted so that it is viewed solely by the left eye, and the right image is 
restricted so that it is viewed solely by the right eye. These techniques 
20 simulate the visual process by which a person sees three dimensionally in 

the real world. 

Although stereoscopic images of the real world have been produced 
for many years by special stereoscopic film cameras, the advent of 

25 computer graphics animation technology has provided another forum for 

generating simulated 3D images. The rendering of the stereoscopic images 
by computer graphics animation involves a similar process as used in 
generating 2D media presentations. As for computer graphics animation 
generated for 2D media presentations, a 3D modelling construct is 

30 generated and manipulated over time. However, when generating 

stereoscopic images, two virtual cameras (a left and a right camera) are 
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created which have slightly offset perspectives. The rendering for each 
camera is performed in the same manner as for standard 2D media 
presentations. In most instances, it is preferable if the left and right 
cameras are fixed to each other in terms of position and camera alignment, 
5 in order to simulate a person's eyes travelling through the computer space. 

As with real world stereoscopic images, two main techniques are 
available for generating stereoscopic computer graphics images. The first 
technique involves aligning the camera axes (or fields of view) of the left 

10 and right cameras so that they are parallel. This method is capable of 

producing orthostereoscope images, in which the relative distances 
between the cameras and the various constructs in computer space and the 
relative sizes of these constructs, essentially match the apparent sizes and 
distances when presented to the viewer. In order to generate 

15 orthostereoscopic images, it is necessary for the separation between the left 

and right cameras to be scaled to match the interocular distance between 
an average person's eyes as if such average person were modelled in the 
computer space. Because the camera axes are parallel, the fields of view do 
not overlap completely. As a result, unless some further step is taken, 

20 strips of non-overlapping (and hence non-stereo) image information exist 
at the left and right edges of the combined left and right images. 

The second technique attempts to address this perceived problem in 
that it involves converging the camera axes of the left and right cameras. 
25 This process creates a plane at which the left and right camera fields of 
view overlap completely. A consequence of converging the camera axes, 
however, is that the stereoscopic images produced, are not 
orthostereoscopic. 

30 The term "stereoscopic camera" is commonly understood by those 

skilled in the art to mean the combination of a left and a right camera 
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linked together for the purpose of generating stereoscopic images. Even 
though it should be understood that a single camera is by necessity 
monoscopic in nature, in order to distinguish between a camera used to 
create the original computer graphics animation intended for 2D 
5 presentation (a "2D camera"), the term "stereoscopic camera", as used in 

this specification including the claims refers to a camera (such as the left or 
right camera) which is being used for the purpose of generating a 
stereoscopic animation sequence. 

10 It has been known to reuse the modelling data and the related 

animation curve data generated for a 2D media presentation, in order to 
render stereoscopic images. However, these techniques do not readily lend 
themselves to reusing the camera animation curves generated in the 
process of creating the 2D media presentation - unless straight line motion 

15 without camera rotation was used to manipulate the original 2D camera, 

as discussed in relation to Figure 2F below, applying a simple transposition 
of the original 2D camera animation curve in order to generate one new 
camera animation path for a second new camera, or alternatively to 
generate two new camera animation paths for two new cameras, results in 

20 serious stereoscopic errors. Consequently, the known techniques have 

required considerable time and expense on the part of the computer 
graphics animators to determine the camera animation curves for the left 
and right cameras, for the intended 3D presentation. Typically this process 
involves reviewing the original 2D presentation, and then estimating the 

25 camera animation curves necessary for the left and right cameras, in order 

for the rendering process to generate stereoscopic sequences which roughly 
parallel the original 2D sequences. 

Accordingly, there is a need for a method and apparatus which 
30 permits efficient reuse of data created during the process of creating 

computer graphics animation for a 2D presentation, in order to create a 3D 
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stereoscopic presentation. 

In the field of generating stereoscopic computer animation 
sequences, it is known to use a spreadsheet to make certain technical 
5 calculations in advance of performing costly rendering, to determine if 

there are potential difficulties with respect to the positioning of the 
cameras in the modelling scene, or with respect to the interocular distance 
between the stereoscopic cameras. Such potential difficulties include 
having an object appearing to be very close to the viewer in real world 
10 space - in these cases, the stereoscopic image is created may cause 

discomfort to the viewer's eyes. 

In the prior art spreadsheets, it was necessary to ensure that the 
modelling units used in generating the modelling constructs in computer 

15 space were scaled to real world units of measurement, such as in feet or 

metres. This enabled the computer graphics animator to determine what 
the apparent location and size in the real world of different objects in the 
scene would be when the 3D animation sequence was displayed. If the 
modelling constructs were not scaled in real world units of measurement, 

20 prior art spreadsheets required the modelling units to first be converted 
into real world units, before the spreadsheet calculations could be 
performed. 

Accordingly, there is also a need for a method of determining 
25 certain characteristics of an animation sequence, such as the apparent (to 

the viewer) size and distance of objects or modelling constructs appearing 
in the sequence, prior to the sequence being rendered, while permitting 
the modelling units to be arbitrary (but consistent) units of measurement. 



30 



SUMMARY OF THE INVENTION 
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The present invention is directed towards a system for generating 
stereoscopic image data from animation data comprising modelling data 
and 2D camera animation curve data generated and stored during the 
process of creating a computer graphics animation sequence(s) for a 
5 monoscopic or 2D presentation. 

In one aspect, the invention comprises a system for generating 
stereoscopic camera animation curve data from 2D camera animation 
curve data. The system comprises a database which stores modelling data 

10 and the 2D camera animation curve data, and a stereoscopic camera 

animation curve data generator. The stereoscopic camera animation 
curve data generator inputs the 2D animation curve data, and generates 
stereoscopic camera animation curve data for stereoscopic cameras. The 
stereoscopic camera animation curve data generator comprises a node 

15 generator which generates a dummy node, a first stereoscopic camera fixed 

in position in position and alignment relative to the dummy node, as well 
as a second stereoscopic camera fixed in position and alignment relative to 
the dummy node and separated from the first stereoscopic camera. 

20 In another aspect, the invention comprises a system for generating 

stereoscopic camera animation curve data from 2D camera animation 
curve data created for a 2D camera. The system comprises a database for 
storing modelling data and the 2D camera animation curve data, and a 
stereoscopic camera animation curve data generator. The stereoscopic 

25 camera animation curve data generator inputs the 2D animation curve 

data, generates a second stereoscopic camera fixed in position and 
alignment relative to the 2D camera and separated from the 2D camera, 
and generates second stereoscopic camera animation curve data. 



30 In yet another aspect, the invention comprises a system for 

generating stereoscopic image data from animation data comprising 
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modelling data and 2D camera animation curve data. This system 
comprises a database in which the modelling data and the 2D camera 
animation curve data are stored, as well as a stereoscopic camera 
animation curve data generator and an animation sequence renderer. The 
5 stereoscopic camera animation curve data generator inputs the animation 

curve data and generates stereoscopic camera animation curve data for at 
least one stereoscopic camera. The renderer inputs the stereoscopic camera 
animation curve data and the modelling data and generates stereoscopic 
image data. 

10 

The present invention is also directed toward a method for 
generating stereoscopic camera animation curve data from 2D camera 
animation curve data, comprising the following steps; 



15 (a) generating a dummy node; 

(b) generating a first stereoscopic camera fixed in position and 
alignment relative to the dummy node; 



20 (c) generating a second stereoscopic camera fixed in position and 

alignment relative to the dummy node and separated from 
the first stereoscopic camera; 

(d) applying the 2D animation curve data to the dummy node; 

25 

(e) generating first stereoscopic camera animation curve data 
correlated to the 2D animation curve data; and 



30 



generating second stereoscopic camera animation curve data 
correlated to the 2D animation curve data. 
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In another aspect, the present invention is also directed toward a 
method for generating stereoscopic camera animation curve data from 2D 
camera animation curve data created for a 2D camera, comprising the 
following steps: 

5 

(a) generating a second stereoscopic camera fixed in position and 
alignment relative to the 2D camera and separated from the 
2D camera; 

10 (b) applying the 2D animation curve data to the 2D camera; and 

(c) generating second stereoscopic camera animation curve data 
correlated to the 2D animation curve data. 

15 In yet another aspect, the present invention is also directed toward a 

method for generating stereoscopic image data from animation data 
comprising modelling data and 2D camera animation curve data, 
comprising the following steps: 

20 (a) generating a dummy node; 

(b) generating a first stereoscopic camera fixed in position and 
alignment relative to the dummy node; 

25 (c) generating a second stereoscopic camera fixed in position and 

alignment relative to the dummy node and separated from 
the first stereoscopic camera; 



30 



(d) 
(e) 



applying the 2D animation curve. data. to the dummy node- 
generating first stereoscopic camera animation curve data 
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correlated to the 2D animation curve data; 

(f) generating second stereoscopic camera animation curve data 
correlated to the 2D animation curve data; 

5 

(g) rendering first stereoscopic image data correlated to the first 
stereoscopic camera animation curve data and to the 
modelling data; and 

10 (h) rendering second stereoscopic image data correlated to the 

second stereoscopic camera animation curve data and to the 
modelling data. 

In still another aspect, the subject invention is directed towards a 
15 system for determining attributes of a stereoscopic image to be generated 
using modelling data and a first stereoscopic camera and a second 
stereoscopic camera. The system comprises an input device and a 
processor capable of receiving measured data from the input device 
correlated to measurements in arbitrary but internally consistent 
20 modelling units taken from the modelling data and the position of the 

first and second stereoscopic cameras, for calculating attribute data 
correlated to attributes of the stereoscopic image in real world units, and 
an output device operationally coupled to the processing means for 
displaying the attribute data. 

25 



BRIEF DESCRIPTION OF THE DRAWINGS 



30 



The present invention will now b t e : described, by way of example- 
only, with reference to the following drawings, in Which like reference 
numerals refer to like parts and in which: 
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Figure 1A is a schematic diagram of the components of a first 
embodiment of the subject invention; 

5 Figure IB is a schematic diagram of the components of an 

alternative embodiment of the subject invention; 

Figure 2A is an overhead view of a representation of a node fixedly 
coupled to a pair of stereoscopic cameras having their camera axes in 
10 parallel alignment, generated in accordance with the subject invention; 

Figure 2B is an overhead view of a representation of the 2D camera 
previously used to generate the original 2D animation sequence, following 
its 2D camera animation curve path; 

15 

Figure 2C is an overhead view of a representation of the node and 
stereoscopic cameras of Figure 2A, in which the 2D camera animation 
curve path of Figure 2B is applied to the node, in accordance with the first 
embodiment of the subject invention; 

20 

Figure 2D is an overhead view of a representation of a node fixedly 
coupled to a pair of stereoscopic cameras having their camera axes 
converged, in which the 2D camera animation curve path of Figure 2B is 
applied to the node, in accordance with the first embodiment of the subject 
25 invention; 

Figure 2E is an overhead view of the 2D camera and 2D camera 
animation curve path of Figure 2B in which the 2D camera is fixedly 
coupled to a second stereoscopic camera as the 2D camera follows its 2D 
30 camera animation curve path, in accordance with the alternative 

embodiment of the subject invention; 
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Figure 2F is an overhead view of the 2D camera and 2D camera 
animation curve path of Figure 2B in which a simple linear 
transformation is applied to the 2D camera animation curve path, to 
5 generate a camera animation curve path for a second stereoscopic camera, 
to illustrate the stereoscopic errors which can occur if the method and 
apparatus of the subject invention is not used; 

Figure 3 is a flow chart showing the method used by the apparatus 
10 of the first embodiment to generate stereoscopic image data; and 

Figure 4 is a flow chart showing the method used by the apparatus 
of the alternate embodiment to generate stereoscopic image data; 

15 Figure 5 is a schematic diagram of the components of a third 

embodiment of the subject invention; and 

Figure 6 is a schematic diagram of a spreadsheet used to implement 
the third embodiment of the subject invention of Figure 5. 

20 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

Referring to Figure 1A, illustrated therein is first embodiment of a 
system for generating stereoscopic image data shown generally as 100 made 

25 in accordance with the subject invention. The system 100 comprises a 2D 

animation database 102, a stereoscopic camera animation curve generator 
104, and an animation sequence Tenderer 106. The animation database 102 
and the animation sequence renderer 106 are both well-known by those 
skilled in the art. , --i 

30 ... 

The 2D animation database 102 stores data previously generated 
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during a process of creating computer graphics animation sequences 
intended for display on 2D media, such as film or video (without 
attempting to create stereoscopic images). The 2D database 102 contains the 
modelling data 108 from the animation sequences, which includes data 
5 correlated to the 3D modelling constructs, as well as the modelling 
animation curve data correlated to the animation curves used to move 
and manipulate the various modelling constructs. The 2D database 102 
also contains 2D camera animation curve data 110 correlated to the 
animation curves applied to the 2D camera in order to view or capture 

10 each frame in the animation sequence. It should be understood that 

references herein to a 2D camera in this specification including the claims 
refers to a virtual camera used in the creation of a computer graphics 
animation sequence intended for presentation on 2D media (without 
attempting to create stereoscopic images). Preferably, the 2D database 102 

15 will also contain 2D rendered data 112 correlated to the animation 

sequences as rendered during the previous 2D animation process. 

It should be understood that the 2D database 102 may be unitary, or 
may comprise several database mechanisms which store some or all of the 

20 2D data 108, 110 and 112. Additionally, it should be understood that the 2D 

database 102 may comprise any form of data storage mechanism which 
utilizes electronic, magnetic or optical storage or similar data storage 
techniques. It should also be understood that the 2D database 102 may be 
physically proximate to the other components of the system 100, or may be 

25 physically remote from the other components. 

The stereoscopic camera animation curve generator 104 is 
electronically coupled to the recipient 2D database 102 so as to be capable of 
retrieving the 2D data 108, 110 and 112. '."The" generator 104 comprises a 
30 node generator 114 for generating a dummy node /and calculating 

stereoscopic camera animation curve data for at least one stereoscopic 



CA 02252063 1998-10-27 



-14- 

camera. 

The node generator 114 typically comprises a suitably programmed 
computer system capable of generating a dummy node 116 (as illustrated 
in Figure 2A). As will be understood by one skilled in the art, the dummy 
node 116 is a mathematical construct which may be positioned and 
oriented in the computer space represented by the modelling data 108, as 
illustrated by node point 118 and node direction vector 120. The node 
generator 114 also creates a left stereoscopic camera 122 and a right 
stereoscopic camera 124 which are fixed in relative position and alignment 
to the dummy node 116, and are spaced from each other. 

At this stage, the characteristics of the left camera 122 and the right 
camera 124, such as field of view, aspect ratio, resolution and horizon 
position, typically have not yet been defined and as with the dummy node 
116, may be treated as points in space represented by left camera point 126 
and right camera point 128, each having a particular orientation illustrated 
by left camera direction vector 130 and right camera direction vector 132, 
respectively. The cameras 122, 124 may be defined as transformation 
functions of the dummy node 116. For illustration purposes, cameras 122, 
124 have been illustrated in Figure 2A as each having a particular field of 
view represented by left camera field of view vectors 134 and right camera 
field of view vectors 136. However, as discussed above, typically the 
characteristics of the cameras 122, 124 have not been defined at this stage 
(although in most instances, they will need to be identical in order to 
render optimal stereoscopic images). 

Referring now to Figure 2B, illustrated therein is a 2D camera 138, 
having a field of view illustrated by 2D camera field of view vectors 140, 
which was used to generate the 2D rendered data 112 correlated to the 
original animation sequences for 2D" presentation. As with the left 
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stereoscopic camera 122 and the right stereoscopic camera 124, 2D camera 
138 may be considered to be a point in space represented as 2D camera 
point 142 having a particular orientation illustrated by 2D camera direction 
vector 144. Dotted line 146 represents the animation curve applied to the 
5 2D camera (and stored as 2D camera animation curve data 110) in order to 

generate the original animation sequences. For the purpose of illustrating 
the effect on the 2D camera 138 as it followed the animation curve 146 
during the original rendering process, 2D camera 138 has been illustrated 
at two points in time, at the start of the animation curve 146 denoted by 
10 'Start', and at the end of the animation curve 146 denoted by 'End'. 

Preferably, the left stereoscopic camera 122, the dummy node 116 
and the right stereoscopic camera 124 are positioned and fixed linearly, 
with the dummy node 116 centred between the left stereoscopic camera 122 

15 and the right stereoscopic camera, as illustrated in Figure 2A. As will be 

understood by one skilled in the art, as noted above, the scaled "camera 
interocular" distance between the left camera 122 and the right camera 124 
will typically be determined by the computer animator, and in most 
instances will preferably be scaled to match the interocular distance 

20 between an average person's eyes as if such average person were modelled 
in the computer space, in order to generate orthostereoscopic animation 
sequences. 

The node generator 104 is programmed to input the 2D camera 
25 animation curve data 110, and apply that data 110 to the dummy node 116. 

Referring now to Figure 2C, as the dummy node 116 tracks along the 2D 
camera animation curve 146 stored in the data 110, the corresponding 
positions and orientations of the left stereoscopic camera 122 and the right 
stereoscopic camera 124 are calculated, thereby defining the left camera 
30 animation curve represented by dotted line .148 for the left camera 122 and - 

the right camera animation curve represented by dotted line 150 for the 
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right camera 124. The data correlated to the animation curves 148, 150 is 
stored respectively as left stereoscopic camera animation curve data 152 
and right stereoscopic camera animation curve data 154. 

5 As will be understood by one skilled in the art, graphics animation 

software typically utilizes a hierarchical structure to manipulate and move 
the modelling constructs within virtual space. Accordingly, most 
modelling constructs are positioned on a hierarchical tree of parents and 
children. Movements and manipulations affecting a parent flow down 
10 the tree and similarly affect the children. However, movements and 
manipulations directed to a child on the tree will not flow up the tree to 
affect the child's parent. 

As should therefore be understood, while the camera animation 
15 curve generator 104 (and node generator 114) may comprise software 

created specifically for the purpose of generating camera animation curves 
in the manner described above, alternatively the types of computer 
animation software which utilize a hierarchical structure offer the 
capability for the dummy node 116 to be created as a parent on a 
20 hierarchical tree, linked in fixed position relative to the cameras 122, 124 

which are created as children to the dummy node 116. As a result, when 
the original 2D camera animation curve is applied to the dummy node 116 
as a parent on the tree, the child cameras 122, 124 maintain their position 
relative to the dummy node 116, from which the respective camera 
25 animation curve data 152, 154 can be determined. 

While Figure 2C illustrates use of the first embodiment of the 
subject invention in which the camera axes (represented by camera 
direction vectors 130, 132) of the left and right cameras 122/ 124 are in 
30 parallel alignment, Figure 2D illustrates use of the first emboHiinent : in 

which the camera axes (represented by camera direction vectors 130', 1320 
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of the left and right cameras 122', 124' are converged. It should be 
understood that the angle of convergence of the orientation of the cameras 
122', 124' has been somewhat exaggerated for illustrative purposes. 

5 The animation sequence Tenderer 106 will typically comprise a 

computer system running standard, commercially available computer 
graphics animation software. Typically such animation software permits 
the characteristics of the camera(s) (such as field of view, aspect ratio, 
resolution and horizon position) to be used in the rendering process to be 
10 determined by the computer graphics animator. The Tenderer 106 is 

capable of retrieving the modelling data 108 stored on the animation 
database 102, as well as the left stereoscopic camera animation curve data 
152 and right stereoscopic camera animation curve data 154. 

15 Some commercial computer graphics animation software 

applications (such as WAVEFRONT ™, by Alias I Wavefront, a division of 
Silicon Graphics Limited) are capable of rendering images as seen from the 
left and right stereoscopic cameras as a single defined operation, provided 
that two camera animation curve paths are specified. With such 

20 animation software, the animation sequence Tenderer 106 will be capable 
of inputting both the left animation curve data 152 and the right 
animation curve data 154 (in addition to the modelling data 108) in order 
to sequentially render the left stereoscopic animation sequence data 156 
and the right stereoscopic animation sequence data 158 corresponding to a 

25 single frame in the animation sequence, for each frame in the animation 

sequence. 

However, some other animation software (such as SOFTIMAGE® by 
Softimage Inc.) is only capable of rendering animation sequences for a 
30 single camera at a time. If such software is used in the Tenderer 106> the 

left animation sequence data 156 and the right animation sequence data 
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158 must be separately rendered by separately inputting the respective 
animation curve data 152, 154. Together, the left sequence data 156 and the 
right sequence data 158 form the 3D animation sequence data 160 to be 
used for stereoscopic display. 

5 

Alternatively, it should be understood that instead of generating the 
complete animation curve data 152, 154 for an animation sequence, the 
node generator 104 may simply generate and output to the animation 
sequence renderer 106 the animation curve data 152, 154 corresponding to 

10 a single frame in the 3D animation sequence, at a time. In this manner, 

the 3D animation sequence data 156, 158 will be generated in parallel with 
the generation of the animation curve data 152, 154. In the event that the 
renderer 106 is only capable of generating the entire animation sequence 
data 156 or 158 corresponding to a single camera 122 or 124 at a time, it 

15 should be readily understood that the node generator 104 may input the 

2D camera animation curve data 110, and apply that data 110 to the 
dummy node 116 to generate and output to the renderer 106 the 
animation curve data 152 or 154 for one of the cameras 122 or 124 
corresponding to a single frame in the 3D animation sequence, at a time. 

20 In a similar fashion, the node generator 104 would then reinput the 2D 

camera animation curve data 110 to generate and output to the renderer 
106 the remaining animation curve data 152 or 154 for the other of the two 
cameras 122 or 124, corresponding to a single frame in the animation 
sequence, at a time. 

25 

Prior to display, the 3D animation sequence data 160 will typically be 
converted and printed onto celluloid for cinematographic projection, or 
into videotape format. As will be understood by one skilled in the art, for 
cinematographic projection, the left sequence data 156 will be converted 
30 and printed onto a separate film (for projection by a separate projector) 

from that of the right sequence data 158. For videotape presentation on a 
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TV screen or similar device, the left sequence data 156 and the right 
sequence data 158 will typically be combined in a manner known in the art 
for display by a single videotape player device connected to a display device 
(such as a TV). 

5 

Figure 3 illustrates the steps of the method 200 carried out by the 
system 100 made in accordance with the first embodiment of the subject 
invention. Once the animation data comprising modelling data 108 and 
2D camera animation curve data 110 generated during a previous process 

10 of creating computer graphics animation sequences intended for 

monoscopic display, has been selected and stored such as in an animation 
database 102, a dummy node 116 which exists essentially as a piece of 
geometry and having a reference point for positioning purposes as well as 
for orientation purposes, is created (Block 202). A first stereoscopic camera 

15 is then generated which is fixed in position and alignment relative to the 

dummy node 116 (Block 204). Similarly, a second stereoscopic camera is 
then generated which is fixed in position and alignment relative to the 
dummy node, and separated from the first stereoscopic camera (Block 206). 
Preferably, the first stereoscopic camera, the dummy node 116 and the 

20 second stereoscopic camera are positioned and fixed linearly, with the 
dummy node 116 centred between the first and second stereoscopic 
cameras, as generally illustrated by left stereoscopic camera 122, dummy 
node 116 and right stereoscopic camera 124, in Figure 2 A. 

25 The 2D camera animation curve data is then applied to the dummy 

node, and first stereoscopic camera animation curve data is generated 
which correlates to the path followed by the first stereoscopic camera as the 
dummy node tracks the 2D camera animation curve data (Block 208). 
Through a similar process, second stereoscopic camera animation curve 

30 data is generated (Block 210). Although the steps showiV in Blofcks 208 and 
210 are listed separately, it should be understood that the first and second 
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camera animation curve data may be generated essentially 
simultaneously. 

Preferably the camera characteristics, such as field of view, aspect 
5 ratio, resolution and horizon position, of the first and second stereoscopic 

cameras may be selected manually (Block 212). Then, in known fashion 
and typically using standard computer graphics animation software, the 
modelling data and the first stereoscopic animation curve data are used to 
render first stereoscopic image data correlated to the intended stereoscopic 

10 animation sequence (Block 214). Similarly, the modelling data and the 

second stereoscopic animation curve data are used to render second 
stereoscopic image data correlated to the intended stereoscopic animation 
sequence (Block 216). Although the steps shown in Blocks 214 and 216 are 
listed separately, it should be understood that the first and second 

15 stereoscopic image data may be generated essentially simultaneously, in 

one operation. 

In some instances, it may be most cost effective to reuse the original 
2D computer graphics animation sequence as the first stereoscopic 

20 animation sequence, and to generate a second stereoscopic animation 

sequence which is rendered using a camera offset to the right or to the left 
from the original 2D camera. As a result, in an alternative embodiment of 
the system, shown generally as 100' in Figure IB, the stereoscopic camera 
animation curve generator 104' only needs to be capable of generating the 

25 camera animation curve data for a second stereoscopic camera. 

Referring simultaneously to Figures IB and 2E, in such instances, 
the node generator 114 illustrated in Figure 1A may be replaced by a second 
stereoscopic camera animation curve generator . 132 v . Camera animation 
30 curve generator 132 creates a second stereoseopic-:camera- -162 fixed in 

relative position and alignment to and spaced from the original 2D camera 
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138. In a similar manner as noted previously in connection with left and 
right cameras 122, 124, the second camera 162 may be considered to be a 
point in space represented as second stereoscopic camera point 166 having 
a particular orientation illustrated by second stereoscopic camera direction 
5 vector 168, as illustrated in Figure 2E. Utilizing a transformation function 

which maintains the fixed positional and camera axes alignment 
relationship between the original 2D camera and the second stereoscopic 
camera, the camera animation curve generator 132 creates second 
stereoscopic camera animation curve data 170 correlated to second 
10 stereoscopic camera animation curve represented by dotted line 172. 

In a similar manner as described in connection with the first 
embodiment, the animation sequence Tenderer 106 inputs the second 
stereoscopic animation curve data 170 (in addition to the modelling data 

15 108) and renders the second stereoscopic animation sequence data 174. The 

computer graphics animator typically inputs the camera characteristics of 
the second camera 162 into the renderer 106 at the rendering stage (at 
which point they should preferably match the camera characteristics of the 
2D camera 138). Together, the 2D rendered data 112 (as shown in dotted 

20 outline) and the second stereoscopic sequence data 174 form the 3D 

animation sequence data 160' to be used for stereoscopic display. 

Figure 4 illustrates the steps of the method 300 carried out by the 
system 100' made in accordance with the alternative embodiment of the 

25 subject invention. Once the animation data comprising modelling data 

108 and 2D camera animation curve data 110 generated during a previous 
process of creating computer graphics animation sequences intended for 
monoscopic display, has been selected and stored such as in an animation 
database 102, a second stereoscopic camera is then generated which is fixed 

30 in position and alignment relative to the 2D camera, and separated from 

the 2D camera (Block 302). The 2D : camera animation curve data is then 
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applied to the 2D camera, and second stereoscopic camera animation curve 
data is generated which correlates to the path followed by the second 
stereoscopic camera as the 2D camera tracks the 2D camera animation 
curve data (Block 304). 

In most instances, the camera characteristics of the second 
stereoscopic camera will simply be required to match the camera 
characteristics of the 2D camera (Block 306). Then, in known fashion and 
typically using standard computer graphics animation software, the 
modelling data and the first stereoscopic animation curve data are used to 
render second stereoscopic sequence data correlated to the intended 
stereoscopic animation sequence (Block 308). 

As should be understood by one skilled in the art, reusing the 
original 2D computer graphics animation sequence as the first stereoscopic 
animation sequence in accordance with the alternative embodiment of the 
subject invention, typically produces stereoscopic animation sequences 
which are slightly less optimal than stereoscopic animation sequences in 
which two new stereoscopic cameras are created in order to render both 
the left and right stereoscopic animation sequence, in accordance with the 
first embodiment of the subject invention. 



The reason for typically preferring the latter approach is that with a 
person's eyes, the centred direction of view (or apparent point of view) 
originates in between the eyes - each eye is slightly offset from this centred 
direction of view. When the left and right eye images are fused by the 
person's brain to generate stereoscopic images, the direction of view that 
the brain perceives originates from the midpoint between the eyes. 



30 



With the 2D camera, thfe direction of view"typicall"y originates from 
the midpoint of the 2D camera, with the optimal direction of view (as 
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determined by the computer graphics animator) centred on the action in 
the sequence. As a result, when the 2D camera animation curve is applied 
to the dummy node of the first embodiment, this optimal direction of 
view is centred between the two stereoscopic cameras. 

5 

However, when the original 2D animation sequence is reused as in 
the alternative embodiment, the optimal direction of view continues to 
originate from the centre of the 2D camera, and not from the mid-point 
between the 2D camera and the second stereoscopic camera. This creates a 

10 slightly offset (from the viewer's perspective) point of view when the two 

sequences are merged to form a stereoscopic image. For objects which 
appear distant, the difference in view from the approaches embodied in 
the first and alternative embodiments will be negligible. However, for 
objects which appear fairly close to the viewer, the offset optimal point of 

15 view may be noticeable. 

It should also be understood that it is possible to use the alternative 
embodiment to generate stereoscopic images in which the camera axes of 
the two stereoscopic cameras are converged. However, doing so results in 
20 images in which the offset is typically more noticeable than when the 

camera axes are in parallel alignment. 

Figure 2F illustrates one example of the stereoscopic errors which 
typically result if the method and apparatus of the subject invention are 

25 not used, and instead, a simple linear transformation is applied to the 

original 2D camera animation curve 146, in order to generate two new 
camera animation curves 146', 146". These curves 146', 146" are applied to 
first new camera 176 and second new camera 178 having first and second 
camera points 180, 182 each having a particular orientation illustrated by 

30 first and second new camera -direction vectors 184, 186, respectively!' *"■ 
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Animation curve 146" is identical in shape to camera animation 
curve 146', but is shifted to the right in Figure IF through a simple linear 
transformation. As is clearly illustrated, if cameras 180, 182 followed their 
respective animation curves 146', 146", they would not maintain a fixed 
5 relative position and alignment between them. Instead, as illustrated, at 

the 'End' of the respective camera animation curves 146', 146", second new 
camera 178 is the same distance to the right of the first new camera 176, in 
absolute terms, but has been shifted in relative terms to appear "in front" 
of the first camera 176 (in the direction of direction vector 184), thereby 
10 effectively preventing the generation of proper stereoscopic images. 

As noted previously, in most instances it is preferable if the two 
stereoscopic cameras are fixed both regarding relative position and camera 
alignment with respect to each other, in order to simulate a person's eyes 
15 travelling through the computer space. Simply transposing the original 

2D camera animation curve to generate camera animation curves for two 
intended stereoscopic cameras can even result in the left camera moving 
to the right (in relative terms) of the right camera. 

20 While the first and alternative embodiments of the subject 

invention have been illustrated and described as using previously 
generated 2D camera animation curve data and modelling data, it should 
be understood that the system and method may be used to generate 
stereoscopic animation sequences using all or only some of the 2D 

25 animation curve data and modelling data. 

In some instances, utilizing the 2D camera animation curve data or 
the modelling data may create undesirable results. Accordingly, in those 
situations it may prove necessary for the computer graphics animator to 
30 modify certain "shots" or sequences slightly, either by modifying :the . 

modelling data or the stereoscopic camera animation curve paths for the 
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two stereoscopic cameras. For example, in some scenes originally intended 
for 2D presentation, the computer graphics animator may insert a 2D 
backdrop of the sky, for example. While it may not be apparent in the 2D 
presentation that the sky is merely a 2D backdrop, when stereoscopic 
5 images are created, sometimes the illusion is pierced and the use of the 

backdrop becomes apparent, requiring correction by the computer graphics 
animator. As well, in a 2D animation sequence, the proximity of the 2D 
camera to objects in the scene is not of particular concern. For stereoscopic 
display, however, as would be understood by one skilled in the art, if the 
10 cameras are too close to an object, the resulting 3D image may create 

discomfort for the viewer. In such cases, entirely new animation curves 
for the stereoscopic cameras may need to be created by the computer 
graphics animator. 

15 It should be understood that the size and shapes of the various 

cameras and nodes in Figures 2A - 2F have been represented for 
illustrative purposes only. As noted previously, the cameras and nodes 
may exist merely as mathematical points having a particular orientation 
or direction. 

20 

It should also be understood that while the camera animation curve 
paths illustrated in Figures 2A - 2F are relatively simple and continuous, 
existing in two dimensions only, typically the camera animation curves 
used to generate computer graphics animation sequences (for 2D or 3D 
25 presentation) are more complex, travelling in three dimensions 

throughout the virtual space, and may be discontinuous. 

Furthermore, it should be understood that while the orientation (or 
alignment) of the cameras and nodes in . Figures 2 A - 2F have been 
30 illustrated as being correlated to the general direction, of movement as the 

camera or node follows its respective animation curve path, it should be 
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understood that as long as the desired relationship between the relative 
positions of the cameras and the orientation of the camera axes (ie. parallel 
or converging) is maintained (in the case of two cameras), it should be 
understood that the axes of the cameras (illustrated by the camera direction 
5 vectors) need not be tangential to the respective camera animation curves. 



Figure 5 illustrates the system, shown generally as 400, which is 
capable of generating data with respect to a proposed animation sequence, 
in accordance with the subject invention. The system 400 comprises a 

10 suitably programmed processing unit 402, a data storage device 404, an 
input device 406, and an output device 408. The system 400 will preferably 
comprise a standard computer system having a suitably programmed 
central processing unit (CPU) 402, a data storage device 404, including 
RAM and ROM and long term storage, an input device 406, such as a 

15 standard computer keyboard and mouse, and an output device 408, such as 

a computer screen. 

The parallax of a subject or object in a scene, is the difference in 
horizontal position of that subject with respect to the left and right 
20 stereoscopic cameras. For a stereoscopic pair of left and right cameras 

separated by a distance I, each having a lens of focal length F, the 
calculation for determining the parallax P of a subject is set out in the 
known equation El: 



25 El. P = 8FI(D-D conv ) / (P^D^D) 

In this equation, D is the distance from the pair of stereoscopic 
cameras, and D conv is the distance at which the stereoscopic cameras are 
converged, if camera convergence is being employed to generate 
30 stereoscopic images. In the modelled computer world, the units for 

measuring the distances of I, D and D conv are all in whatever arbitrary units 
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the animator selected (eg. graph units). From equation El, it can be seen 
that as a result of division, all of the units for I, D and D conv in the 
numerator and denominator cancel out, leaving the units for F, the focal 
length. Accordingly, the units of parallax, P, will correspond to the units 
5 for F. 

In any camera system, focal length determines the angular field of 
view. This is illustrated by the known equation E2, in which W represents 
the dimension of the final image, and 0 represents the field of view in 
10 which 0 and W are measured in the same direction (ie. vertically or 
horizontally): 

E2. F = W/ 2tan(0/2) 

15 In most computer graphics animation software applications, the 

field of view, 0, of the software camera being utilized by the application 
can be easily determined. From equation E2, it is apparent that the units of 
F will correspond to the units used to measure W. Thus, if the final 
destination of the stereo images are to be printed onto film, for example, 

20 and the units of the dimension of the film, W, are in millimetres (eg. 

70mm film), which is typically the case, then the focal length F will also be 
defined in millimetres. 

Once the values for I, D and D conv have been determined with 
25 respect to a particular subject, the focal length F as calculated in equation 

E2 may also be substituted into equation El to determine what the parallax 
of the subject would be on film. Accordingly, the calculated parallax will 
also be in the same real world units as for the dimension of the image, W. 

30 Since the magnification from film to the final viewing screen is a 

known quantity, the effect on the audience can be accurately calculated 
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using this calculated parallax, and known stereoscopic equations. Utilizing 
the equations El, E2 in this manner enables the automatic mapping of 
potentially arbitrary computer world modelling units into real world 
viewer space. 

Preferably, the processing unit 402 of the system 400 will comprise a 
spreadsheet program for generating a spreadsheet 410 as illustrated in 
Figure 6. The spreadsheet 410 has a set of cells 412-422, into which 
following values in computer modelling units taken from the computer 
model are entered: Camera Field of View 412 corresponding to the field of 
views of the left and right stereoscopic cameras, Camera Separation 414 
corresponding to the distance between the left and right stereoscopic 
cameras, Convergence Distance 416, Prime Subject Distance 418 
corresponding to the distance of the subject from the left and right 
stereoscopic cameras, Subject Size 420 corresponding to the size of the 
subject and Far Subject Distance 422 corresponding to the distance to the 
farthest visible object in the computer model, whenever convergence is 
smaller than infinity (ie. whenever the left and right cameras are 
converged and not in parallel alignment). If the left and right and right 
cameras are in parallel alignment (and not converged), very large values 
representing effective infinity (such as 1.00E+10) are entered into the 
Convergence Distance 416 and the Far Subject Distance 422 cells. The 
values entered into the set of cells 412-422 may be in any arbitrary, but 
internally consistent, modelling units (except for the Camera Field of View 
412 cell, which is typically in degrees, or correlated units). 

The spreadsheet 410 also has a set of cells 424, 426, in which the 
values in real world units (typically metres or feet) for Subject Theatre 
Distance 424 corresponding to the distance the subject will appear from the 
viewer, and Subject Theatre. Size 426 corresponding to the size the subject 
will appear to the viewer, are calculated and displayed. 
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The formula used by the cell 424 to calculate the Subject Theatre 
Distance, D theatre is set out in equation E3: 

5 E3. Dtheatre = (^viewer / (^viewer + " K^D^^^ 

in which I V j e wer * s ^ e interocular distance between the viewer's eyes and K 
is the alignment constant representing the separation between the left and 
right eye images on the screen at infinity, as would be understood by one 

10 skilled in the art. The human average of 65mm is typically used for this 

value. M is the magnification from film frame to theatre screen 
(approximately 350 times, in a large format theatre) and P is the film 
parallax calculated in accordance with equation El, discussed above. D^g^ 
is the viewer's seating distance from the screen, and the distance for D theatre 

15 calculated through equation E3 is in the same units as used for D screen 

(since as discussed above, parallax, P, is typically calculated in millimetres, 

as is I v iewer)* 

The formula used by cell 426 to calculate the Subject Theatre Size, 
20 S t heatre/ * s set out ^ equation E4: 

E4 * S theatre= MS film ^theatre / D screen) 

in which S film is the size of the image on the film. The size of the image on 
25 film is a result of the distance from the subject to the camera and camera 

focal length, which will be the same for both the left and right images. 

Sf ilm is calculated and substituted into equation E4, using the 
following equation E5: 



30 
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E 5 - ^Bkn ~ F (Scomp / D comp) 

in which F is the focal length calculated previously, and S comp and D comp are 
the values of the size of the subject and the distance of the subject from the 
5 cameras, respectively, in computer modelling units. Since the modelling 

units cancel out from the numerator and the denominator in equation E5, 
Sfilm ke in the same units as F (typically millimetres). 

When convergence is used in generating stereoscopic images, any 
10 subject further from the camera than the convergence distance has its 

parallax reversed, with the right eye image moving to the right of the left 
eye. Since human eyes are not equipped with muscles that allow our eyes 
to rotate outwards (diverge), there are limits to how much of this is 
allowed before the stereoscopic illusion will fail and cause discomfort for 
15 the viewer. The amount of this divergent parallax increases with distance. 

The spreadsheet 410 is therefore provided with a cell 428 which 
calculates the divergent parallax, P div corresponding to the value in the 
Far Subject Distance Cell 422, using equation El in which P div is substituted 
20 for P, and the value in the Distance Cell 422 is substituted for D. The 

parallax value, P div calculated by cell 428 is used by the Far Subject Front 
Row Divergence Angle cell 430 to calculate the divergence or outward 
rotation angle, o div/ as seen by the person in the front row of the theatre 
(which is the worst case position), using equation E6: 

25 

E6. 0div = 2atan((MP-K)/2D close ) 

in which D close is the closest distance anyone will be seated from the 
viewing screen. The value calculated by the spreadsheet 410 in the Far 
30 Subject Front Row Divergence Angle cell 430 should never exceed one 
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degree, the accepted standard tolerance for divergence. If this value 
exceeds one degree, the computer animator will have to reconfigure either 
the positions of the left and right stereoscopic cameras in the scene, or 
manipulate the objects in the scene to ensure that this divergence angle is 
5 reduced to one degree or less. 

Thus, while what is shown and described herein constitutes 
preferred embodiments of the subject invention, it should be understood 
that various changes can be made without departing from the subject 
10 invention, the scope of which is defined in the appended claims. 
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I Claim: 

1. A system for generating stereoscopic camera animation curve data 
5 from 2D camera animation curve data, comprising: 

(a) database means for storing modelling data and the 2D camera 
animation curve data; and 

10 (b) stereoscopic camera animation curve data generation means 

responsive to the 2D animation curve data, for generating 
stereoscopic camera animation curve data for stereoscopic 
cameras, comprising node generation means for generating a 
dummy node and for generating a first stereoscopic camera 

15 fixed in position relative to the dummy node and for 

generating a second stereoscopic camera fixed in position 
relative to the dummy node and separated from the first 
stereoscopic camera. 

20 

2. A system for generating stereoscopic camera animation curve data 
from 2D camera animation curve data created for a 2D camera, comprising: 

(a) database means for storing modelling data and the 2D camera 
25 animation curve data; and 

(b) stereoscopic camera animation curve data generation means 
responsive to the 2D animation curve data, for generating a 
second stereoscopic camera fixed in position and alignment 

30 relative to the 2D camera and separated from the 2D camera 

and for generating second stereoscopic camera animation 
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curve data. 

3. A system for generating stereoscopic image data from animation 
data comprising modelling data and 2D camera animation curve data, 
comprising: 

(a) database means for storing the modelling data and the 2D 
camera animation curve data; 

(b) stereoscopic camera animation curve data generation means 
responsive to the animation curve data, for generating 
stereoscopic camera animation curve data for at least one 
stereoscopic camera; and 

(c) rendering means responsive to the stereoscopic camera 
animation curve data and responsive to modelling data for 
rendering stereoscopic image data. 

4. The system as defined in claim 1, wherein the animation data also 
comprises 2D image data. 

5. The system as defined in claim 1, wherein the stereoscopic camera 
animation curve data generation means comprises node generation 
means for generating a dummy node and for generating a first stereoscopic 
camera fixed in position and alignment relative to the dummy node and 
for generating a second stereoscopic camera fixed in position and 
alignment relative to the dummy node and separated from the first 
stereoscopic camera. 

6. The system as defined : in claim 5, wherein the dummy node is 
located equidistant between the first stereoscopic camera and the second 
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stereoscopic camera. 

7. A method for generating stereoscopic camera animation curve data 
from 2D camera animation curve data, comprising the following steps: 

(a) generating a dummy node; 

(b) generating a first stereoscopic camera fixed in position and 
alignment relative to the dummy node; 

(c) generating a second stereoscopic camera fixed in position and 
alignment relative to the dummy node and separated from 
the first stereoscopic camera; 

(d) applying the 2D animation curve data to the dummy node; 

(e) generating first stereoscopic camera animation curve data 
correlated to the 2D animation curve data; and 

(f) generating second stereoscopic camera animation curve data 
correlated to the 2D animation curve data. 

8. A method for generating stereoscopic camera animation curve data 
from 2D camera animation curve data created for a 2D camera, comprising 
the following steps: 

(a) generating a second stereoscopic camera fixed in position and 
alignment relative to the 2D camera and separated from the 
2D camera; 

(b) applying the 2D animation curve data to the 2D camera; and - 
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(c) generating second stereoscopic camera animation curve data 
correlated to the 2D animation curve data. 

5 9. A method for generating stereoscopic image data from animation 

data comprising modelling data and 2D camera animation curve data, 
comprising the following steps: 



10 



(a) generating a dummy node; 

(b) generating a first stereoscopic camera fixed in position and 
alignment relative to the dummy node; 

(c) generating a second stereoscopic camera fixed in position and 
15 alignment relative to the dummy node and separated from 

the first stereoscopic camera; 

(d) applying the 2D animation curve data to the dummy node; 



20 



25 



30 



(e) generating first stereoscopic camera animation curve data 
correlated to the 2D animation curve data; 

(f) generating second stereoscopic camera animation curve data 
correlated to the 2D animation curve data; 

(g) rendering first stereoscopic image data correlated to the first 
stereoscopic camera animation curve data and to the 
modelling data; and 

(h) rendering second stereoscopic image data correlated to the 
second stereoscopic camera animation curve data and to the 
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modelling data. 

10. The method as defined in claim 9, comprising inputting first camera 
characteristic data and second camera characteristic data. 

11. A system for determining attributes of a stereoscopic image to be 
generated using modelling data and a first stereoscopic camera and a 
second stereoscopic camera, comprising: 

(a) an input device; 

(b) processing means capable of receiving measured data from 
the input device correlated to measurements in arbitrary but 
internally consistent modelling units taken from the 
modelling data and the position of the first and second 
stereoscopic cameras, for calculating attribute data correlated 
to attributes of the stereoscopic image in real world units; and 

(c) an output device operationally coupled to the processing 
means for displaying the attribute data. 
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ABSTRACT OF THE DISCLOSURE 

A system and corresponding method for generating stereoscopic 
image data from modelling data and camera animation curve data created 
5 in the process of creating a computer graphics animation sequence 

intended for 2D display. The system comprises a database in which the 
modelling data and the original camera animation curve data are stored, 
as well as a stereoscopic camera animation curve data generator and an 
animation sequence renderer. The stereoscopic camera animation curve 

10 data generator inputs the original camera animation curve data and 
generates stereoscopic camera animation curve data for at least one 
stereoscopic camera which is fixed in position and alignment with respect 
to another stereoscopic camera (which may be the original camera used to 
generate the original computer graphics animation sequence). The 

15 renderer inputs the stereoscopic camera animation curve data and the 

modelling data and generates stereoscopic image data. 
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